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Abstract 

Small-to-medium size enterprises (SMEs), including many startup firms, need to manage inter¬ 
related flows of cash and inventories of goods. In this paper, we model a firm that can hnance its 
inventory (ordered or manufactured) with loans in order to meet random demand which in general 
may not be time stationary. The firm earns interest on its cash on hand and pays interest on its 
debt. The objective is to maximize the expected value of the hrm’s capital at the end of a hnite 
planning horizon. Our study shows that the optimal ordering policy is characterized by a pair of 
threshold variables for each period as function of the initial state of the period. Further, upper and 
lower bounds for the threshold values are developed using two simple-to-compute ordering policies. 
Based on these bounds, we provide an efficient algorithm to compute the two threshold values. Since 
the underlying state space is two-dimensional which leads to high computational complexity of the 
optimization algorithm, we also derive upper bounds for the optimal value function by reducing the 
optimization problem to one dimension. Subsequently, it is shown that policies of similar structure 
are optimal when the loan and deposit interest rates are piecewise linear functions, when there is a 
maximal loan limit and when unsatisfied demand is backordered. Finally, further managerial insights 
are provided with numerical studies. 

KEYWORDS: Inventory, finance, decision, threshold variables, myopic policy. 


1 Introduction 


In the current competitive environment, small-to-medium size enterprises (SMEs), including many 
startup firms, must make joint decisions concerning interrelated flows of cash and products; cf. |MaRS| 
(10 Apr. 2014). Cash is the lifeblood of any business and is often in short supply. Cash flows stem from 


operations, financing and investing activities. To maximize profits, firms need to manage operations, 
financing and investing activities, efficiently and comprehensively. For example, most startup firms need 


access to funds, typically for ordering or manufacturing products; cf. Zwilling (6 Mar. 2013). As another 


example, some small businesses are seasonal in nature, particularly retail businesses. If a business makes 
most of its sales during the holiday season, it may need a loan prior to the holiday season to purchase 
a large amount of inventory to gear up for that season. Such loans to purchase inventory are generally 
short-term in nature and companies usually pay them off after the season is over with the proceeds of 
sales from their seasonal sales. 


To facilitate SME borrowing. Small Business Administration (SBA) has established a loan program with 
a successful record. For example, Wells Fargo Capital Finance is the nation’s leading provider (by dollar 
volume) of loans guaranteed by the SBA, providing loans to companies across a broad range of industries 
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throughout the United States. Building on a strong track record, Wells Fargo works with companies in 
many diverse industries, including apparel, electronics, furniture, housewares, sporting goods, toys and 
games, food products, hardware, and industrial goods. Accordingly, small business loans at Wells Fargo 


rose 18% in 2014; cf. Reuters (14 April 20151, WellsFargo.com (11 May 2015) and Finance.Yahoo.com 
(14 May 20l^. 


In this paper we model and analyze the optimal financial and operational policy of an SME firm whose 
inventory is subject to lost sales, zero replenishment lead times and periodic review over a finite planning 
horizon. The firm’s state (i.e., inventory-capital profile) consists of inventory level and cash level, where 
a positive cash level represents cash on hand while a negative cash level represents a loan position. Cash 
flows are managed from the perspectives of operations, financing and investing in each period, as follows, 
(i) From the operations perspective, the firm stocks up and sells inventory; (ii) From the financing per¬ 
spective, the firm can use its cash on hand or an external short-term loan (if needed) to procure products 
for inventory; (iii) From the investing perspective, any cash on hand is deposited in a bank account to 
earn interest at a given rate, while debt incurs interest at a higher given rate. We develop and study a 
discrete-time model for a single-product inventory system over multiple periods. The objective of the 
firm is to dynamically optimize the order quantities in each period, given the current state of cash and 
inventory, via joint operational/financial decisions, so as to maximize the expected value of the firm’s 
capital (i.e., total wealth level) at the end of a finite time horizon. 


The inventory flow is described as follows. At the beginning of each period, the firm decides on an 
order quantity and the corresponding replenishment order materializes with zero lead time. During the 
remainder of the period, no inventory transactions (demand fulfillment or replenishment) take place. 
Rather, all such transactions are settled at the end of the period. Incoming demand is aggregated over 
that period, and the total period demand draws down on-hand inventory. However, if the demand ex¬ 
ceeds the on-hand inventory, then all excess demand is lost (the backorder setting is studied in (8.3). 
All the leftover inventory (if any) is carried forward to the next period subject to a holding cost, and at 
the last period, the remaining inventory (if any) is disposed of either at a salvage value or at a disposal 
cost. 


Cash flow typically takes place as follows. All transactions pertaining to previous period are settled 
at its end. More precisely, the firm updates its cash position with the previous period’s revenue from 
sales and interest earned from a deposit, or paid on outstanding debt (if any). The firm then decides 
the order quantity for the next period and pays for replenishment as follows: first, with cash on hand, 
and if insufficient, with a withdrawal from cash on deposit (there is no withdrawal penalty), and if still 
insufficient, by an external loan. If not all cash on hand is used for replenishment, then any unused cash 
is deposited in a bank where it earns interest. At the end of each period the resulting cash on hand or 
debt are carried forward to the next period. 

The main contribution of the paper is to establish and compute the optimal ordering policy in terms of 
the net worth of the firm (operating capital in in product units and inventory on hand) at the beginning 
of each period. It is shown that the optimal policy is characterized for each period n by a pair of threshold 
variables, and fin where < /3„; cf. Theorem[^for the single period problem and Theorem|^for the 
multi-period problem. The threshold values, a„ and fim are in general functions of the firm’s net worth. 
This optimal policy has the following structure: a) If the net worth is less than a„, then the firm orders 
up to q:„, a case referred to as the over-utilization case, b) If the net worth is greater than /3„, then the 
firm orders up to /3„, a case referred to as the under-utilization case, c) Otherwise, when the net worth 
is between a„ and /?„, then the firm orders exactly as many units as it can afford without borrowing, a 
case referred to as the full-utilization case. For the single period problem, we further derive the optimal 
solution in closed form and show that the (a, fi) optimal policy yields a positive expected value even 
with zero values for both initial inventory and cash. For the multi-period problem, we construct two 
myopic policies, which provide upper and lower bounds for the threshold values, respectively. Based 
on these upper and lower bounds, we provide an algorithm for computing the two thresholds, and 
fin, recursively for all periods n. Since the underlying state space is two-dimensional, it leads to high 
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computational complexity of the optimization algorithm, we derive upper bounds for the optimal value 
function by reducing the optimization problem to one dimension. Subsequently, it is shown that policies 
of similar structure are optimal when the loan and deposit interest rates are piecewise linear functions, 
when there is a maximal loan limit and when unsatisfied demand is backordered; cf. Theorems §0 and 
respectively. 

The remainder of this paper is organized as follows. Section reviews related literature and Section 
formulates the model. In Section]^ the single-period model is developed and the optimal {a,j3) policy 
is derived, where the threshold values are functions of the demand distribution and the cost parameters 
of the problem. Section extends the analysis for the dynamic multi-period problem and derives a 
two-threshold structure, (a„,/3„) policy, for the optimal policy via a dynamic programming analysis. 
Section [^introduces two myopic policies that provide upper and lower bounds for each a„ and /?„, based 
on which an efficient searching algorithm for and /3„ is presented. An upper bound for the value 
function is also introduced. Numerical studies are presented in Section In Section [^ it is pointed 
out that simple modifications of the underlying model allow the extension of the results to the case 
of piecewise linear interest rate functions, a maximal loan limit and backorder of unsatisfied demand. 
Finally, Section concludes the paper. All proofs are relegated to the appendix. 


2 Literature Review 


In a seminal study, Modigliani and Miller (19581 show that in a perfect capital market with adequate and 


inexpensive external funding, a firm’s operational and financial decisions can be made separately. Since 
then, most literature in inventory management extended the classical newsvendor problem in a variety of 
ways, but assuming that decision makers are not subject to financial constraints. However, in view of the 
imperfection of real-life capital market, a growing body of literature has begun to consider operational 
decision making subject to financial constraints. In those studies, inventories of goods are often treated 
as special financial instruments; cf. Singhal ( 1988| ). Accordingly, portfolios of physical products and 
financial instruments have been studied using finance/investment principles such as Modern Portfolio 
Theory (MPT) and Capital Asset Pricing Model (CAPM). For related literature, the reader is referred to 


Corbett et al. (1999) and references therein. Further, the relationship between inventories and finance, 


along with their theoretical and empirical consequences, are discussed in Girlich (20031. 


The growing literature on the interface between operations management and financial decisions can be 
categorized into two major strands: single-agent and game related multiple-agent streams. Each stream, 
attendant models can be further classified as single-period and multi-period models. Our study belongs 
to the single-agent strand and addresses both single-period and multi-period models. 


In the single-agent strand, a firm operational decisions and financial decisions are typically made simul¬ 
taneously, but without interacting with other firms. Considering an imperfect market, |Xu and Birge| 
(20041 develop models with simultaneous production and financing decisions in the presence of demand 


uncertainty, which illustrates how a firm’s production decisions are affected by the existence of financial 


constraints. Recently, Birge and Xu (2011) present an extension of a model in Xu and Birge (2004) by 


assuming that debt and production scale decisions have fixed costs necessary to maintain operations, 
variable costs of production, and volatility in future demand forecasts. Building on their previous work 
of Xu and Birge (20041, Xu and Birge (2008) review that analysis and consider the effect of different op¬ 


erating conditions on capital structure, and exhibit some empirical support of their previously predicted 


relationship between production margin and market leverage. Cai et al. (2014) investigate the roles of 


bank and trade credits in a supply chain with a capital-constrained retailer facing demand uncertainty. 
The studies above focus on single-period problems. 


Some single-agent, multi-period problems are addressed in Hu and Sobel (2005) and Li et al. (2013). 
Here, multi-period models posit different interest rates on cash on hand and outstanding loans. These 
papers also demonstrate the importance of the joint consideration of production and financing decisions 
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in a start-up setting in which the ability to grow the hrm is mainly constrained by its limited capital 
and dependence on bank financing. For example, Hu and Sobel (20051 examine the interdependence 


of a firm’s capital structure and its short-term operating decisions concerning inventories, dividends, 


and liquidity. To this end, Hu and Sobel (20051 formulate a dynamic model to maximize the expected 


present value of dividends. Li et al. (20131 study a dynamic model of managerial decisions in a manu¬ 


facturing firm in which inventory and financial decisions interact and are coordinated in the presence of 
demand uncertainty, financial constraints, and default risk. It is shown that the relative financial value 
of coordination can be made arbitrarily large. In addition, Gupta and Wang (20091 study a retailer’s 


dynamic inventory problem (both discrete and continuous review) in the presence of random demand 
while the retailer is financially supported by trade credit from its supplier, contingent on the age of the 
inventory. It is shown that the optimal policy is a base stock policy where the base stock level is affected 


by the offered credit terms. Luo and Shang (2013) study a centralized supply chain consisting of two 


divisions (modeled as echelons), of which the headquarter division manages the financial and operational 
decisions with a cash pool. They focus on analyzing the value of cash pooling. 


The work most closely related to this study is Chao et al. (2008) and Gong et al. (2014). The first 


reference considers a single-agent multi-period problem for a self-financing retailer without external loan 
availability. It shows that the optimal, cash flow-dependent, policy in each period, is uniquely determined 


by a single critical value. Our study differs from Chao et al. (2008) in several ways. First, from a model 


ing perspective, Chao et al. (2008) consider a self-financing firm without access to external credit, while 


we consider possible loan which provides the retailer with the flexibility of ordering a larger quantity to 
achieve a higher hll rate. The consideration of loan intertwines the financial decision (e.g., how much 
to borrow) with the operational decision (e.g., how many to order) as well as the investment decision 
(how much to deposit for additional interest). In this case, the complexity of the problem is raised from 
one dimension (operational decision alone) to two dimensions (joint operational and financial decisions). 
Further, Chao et al. (2008) assume an iid demand process and time-stationary costs, while we consider 


a non-stationary demand process and time varying (loan and deposit) interest rates. Second, in terms 


of results, Chao et al. (2008) structure the optimal policy as a base stock policy with a single threshold 


value; while our paper shows that the optimal policy is characterized by two threshold values, which 
divide the ordering decision space into three intervals to guide financing, operational and investment 


decisions. Gong et al. (2014) study a similar model to maximize the expected terminal total capital but 
along different lines from ours. However, this paper differs in several aspects as follows. In terms of 
model setting, we consider non-stationary demand process and time varying (loan and deposit) interest 
rates as well as an extension to realistic piecewise loan rates. In terms of results, our optimal policy 
is presented in terms of two thresholds per period (multiple thresholds for the case of piecewise loan 
rates), while Gong et al. ( |2014 ) analyze a single-threshold policy. Computationally, we develop simple 
easy-to-compute policies (based on single period information) which provide lower and upper bounds 
for each of the two threshold values, and we propose an efficient algorithm for the computation of the 
optimal policy. Further we provide upper and lower bounds for the value function. Finally we develop 
further managerial insights into the interplay between operational, financial and investment decisions. 

In a second strand of the literature, multi-agent competition between firms and financial institutions has 


been investigated using game theoretic approaches. This literature includes, but is not limited to, Buza- 


cott and Zhang 

(2004) 

Dada and Hu 

(2008) 

Yasin and Gaur ( 

2012 

) and 

Raghavan and Mishra ( 

2011). 

Most such papers deal with a single-period p 
game between the bank and the retailer in a 

roblem. Buzacott and Zhang 

(2004) analyzes a Stackelberg 

newsvendor inventory model. |Dada and Hu (2008 

) assume 


that the interest rate is charged by the bank endogenously and use a game model to capture the relation 
between the bank and the inventory controller through which an equilibrium is derived and a non-linear 


loan schedule is obtained to coordinate the channel. Yasin and Gaur (2012) study the implications of 


asset based lending for operational investment, probability of bankruptcy, and capital structure for a 


borrower firm. Raghavan and Mishra (2011) study a short-term financing problem in a cash-constrained 
supply chain. 


As a part of the second literature strand, multi-agent game-theoretic approaches have also been used 


4 
































































































to model the competition between suppliers and retailers. Such recent studies include [Kouvelis and| 


Zhao (2011a) and Kouvelis and Zhao (2011b) among many others. An important portion of this strand 


addresses the impact of trade credits provided by suppliers to retailers. Lee and Rhee (2010) study 


the impact of inventory financing costs on supply chain coordination by considering four coordination 
mechanisms: all-unit quantity discount, buy backs, two-part tariff, and revenue-sharing. It is shown 
that using trade credits in addition to contracts, a supplier can fully coordinate the supply chain and 
achieve maximal joint profit. Further, Lee and Rhee ( 2011| model a firm with a supplier that grants 
trade credits and markdown allowances. Given the supplier’s offer, it determines the order quantity 
and the financing option for the inventory under either trade credit or direct financing from a financial 
institution. The impact of trade credits from an operational perspective is also studied in |Yang arid 


Birge (2013), which investigates the role that trade credit plays in channel coordination and inventory 


financing. It is shown that when offering trade credits, the supplier balances its impact on operational 


profit and costs. Other related work of ours includes: Shi et al. (2014), Katehakis and Smit (2012), Zhou 


et al. (2007), Zhao and Katehakis (2006). 


3 Model Formulation 

Consider a time horizon .jV := {1, 2,..., A^} where the periods are indexed forward. At the beginning 
of period n G let the “inventory-capitar state of the system be characterized by a vector (xn,yn), 
where Xn > 0 denotes the amount of on-hand inventory (number of product units) and denotes the 
amount of product that can be purchased using all the available capital, i.e., is the capital position 
measured in “product units”. Let Qn ^ 0 denote the order quantity the firm uses in the beginning of 
period n G JV. The ordering cost per unit is c„ > 0. We assume that any order quantity can be fully 
satisfied within zero lead time of replenishment. Let G 3?”'' denote the random demand during period 
n which follows a general distribution. We assume that demands of different periods are independent 
but could be generally non-stationary across periods. Let /n(-) and F'„(-) denote the probability density 
function (pdf) and the cumulative distribution funetion (cdf) of respectively. The selling price per 
unit is Pn > c„. 

Throughout all periods n = 1,...,A^ — 1, any unsold units are carried over in inventory to be used in 
subsequent periods subject to a constant holding cost h„ > 0 per unit over period n, and any unmet 
demand is lost. The backorder setting of the problem is studied in §8.3[ At the end of the horizon, 
i.e., the end of period N, all leftover inventory (if any) will be salvaged (or disposed off) at a constant 
price (cost) s per unit. Note that we allow a negative s in which case s represents a disposal cost 
per unit, e.g., the unit cost of disposing vehicle tires. For notational convenience, we denote hpj = —s 
in the sequel, so that the salvage value (or disposal cost) s is treated uniformly as a type of inventory cost. 

To finance inventory, a loan can be applied at interest rate £„ > 0. Interest rates are fixed and depend 
entirely upon current market conditions. For example, Lending Club provides Small Business Loans at a 
fixed rate financing up to $300,000 (Lending Club is a US peer-to-peer lending company, headquartered 
in San Francisco, California). When there remains unused capital after an ordering decision, the unused 
capital is deposited in a bank account to earn interest at rate in > 0. To avoid trivialities, we assume 
that in < £n and it is possible to achieve a positive profit with the aid of a loan, i.e., (1 -|- £n)cn < Pn- 
This assumption can be equivalently written as 1 -I- < Pn/cn- Note also, that the above assumption 

implies !-!-*„< Pnjc-n since < tn-, namely, investing on inventory is more profitable than depositing 
available capital in the bank. 

Given the initial inventory-capital state as (a:„,j/„), if an order of size > 0 is placed and the demand 
during the period is then we have the following operational and financial cash inflows: 

• The cash flow from operational sales of items (i.e., the realized revenue from inventory) at the end 
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( 1 ) 


of the period is given by 

Qn^ ^n) — Pn ’ loin^f^^ -\- Xjij -^n} ‘ \Pn “t“ ^n\ 

— Pn ‘ \Q_n “t“ Xn (^n “t“ Xn -Dyi)"*"] hji • \qji Xn 

— Pnisin “t” ^n) {Pn “t“ hn) ' [(^n “f 

where [a]"*" = max{a, 0} denotes the positive part of real number a, and the second equality holds 
by min{a, 6} = a — [a — &]■*■. 


• The cash flow from capital (i.e., the realized revenue from financial investment) at the end of the 
period is computed for each of the following investing and financing scenarios: 

i) Investing decision: If the order quantity satisfies 0 < < ?/„, then the leftover amount 

Cn’iyn—qn) of cash is deposited in the bank and will yield a positive inflow of c„-(y„—g„)(l+in) 
at the end of the period n. 

ii) Financing decision: If the order quantity satisfies > ?/„ (including the case Qn = 0 > ?/„), 
then a loan amount of c„ • (q„ — Vn) will be borrowed during the period and will result in a 
cash outflow of c„ • (g„ — 2 /n)(I + in) at the end of the period. 

In summary, the cash flow from the bank (positive or negative) can be written in general as 

Vn) — Cn * {Pn Qn) [(1 d” (I “t“ • (2) 


Note that the cash inflow from inventory, i?„(II„, ( 7 „, a;„) is dependent on while independent of 
In a similar vein, the cash flow from capital, KnipniVn) is independent of the initial on-hand inventory, 
Xn and the demand size Dn, but is dependent on yn- Also, note that the ordering cost, c„ • qn, has been 
accounted for in Eq. (§ while the remaining capital, if any, is invested in the bank and its value at the 
end of the period is given by Kn{qn, Vn)- 


Since the order quantity = gni^mUn) is decided at the beginning of period n as a function of (x„, y„), 
it is readily shown that the state process {{xn,yn)} under study is a Markov decision process (MDP) 
with decision variable g„; cf. Ross (1992). The state dynamics of the system, i.e., inventory flow and 
cash flow, are given as follows, for n = 1,2,..., — 1 

^n+l — [^n T Qn d-^n] 5 (d) 

Vn+l ~ [dd7i{didn: Qm ^n) d^niQn-; Un)]/^n+1: (d) 

where i?„ and Kn refer to the capital gain from operational and financial decisions, as given by Eqs. 
0-§> respectively. 

Note that, at the beginning of period n, the interplay between finance and operation is one way. Namely, 
it is feasible to purchase products with available capital ?/„ (when ?/„ >0), but it is typically restricted 
to convert any on-hand inventory Xn into cash. Conversely, the sales interplay between finance and 
operations is opposite, namely, sales deplete the inventory and contributes to cash on hand. 

Thus, we have the following dynamic programming formulation: 


VniXn,yn) = SUp E 


1^-t-l (:^n+l) Vn+l) \ ^n ; Vn 


n = 1,2,--- - 1 


(5) 


qn>0 L 

where the expectation is taken with respect to Dn, and Xn+i, Pn+i are given by Eqs. (|^, Q, respectively. 
For the final period N, we have 


Vn{xn, Vn) 


sup E 

qN>0 


Rn{Dn, Qn, Xn) + KN{qN, Vn) 


( 6 ) 
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4 The Single Period Problem 


The analysis of the last period TV is a typical single-period problem and its objective function is given 
by Eq. (§. For notational convention, we omit the subscript N for each related variable when denoting 
counterparts under the single period setting, without causing any confusion. 

Accordingly, for any given initial “inventory-capital” state (x, y) and ordering decision 9 > 0, the ex¬ 
pected value of net worth at the end of the period is given by 


G(9, x,y)=p{x + q)-{p- s) 


fX+q 


{x + q-t)f{t)dt + c{y - q) 


(1 -I- i)l{q<y} + (1 + ^)l{(3>y} 


(7) 


The following lemma summarizes the important properties of the function G{q,x,y). 

Lemma 1. Function G{q,x,y) is continuous in q, x and y, and it has the following properties, 
i) It is concave in q G [0, 00 ), for all x, y and all s < p. 
ii) It is increasing and concave in x, for s > 0. 

Hi) It is increasing and concave in y, for all s < p. 


Remarks. 


1. It is important to point out that G{q,x,y) might not increase in a; if s < 0. In particular, if s 
represents a disposal cost, i.e., s < 0, then dG{q,x,y)/dx might be negative, which implies that 
G{q,x,y) is decreasing for some high values of x. 


Further, for the special case s < 0, it is of interest to locate the critical value, x' such that G{q, x, y) 
is decreasing for x > x'. To this end, we set Eq. (46) to be zero, which yields 


{p — s) ■ F{q + x) = p. 


( 8 ) 


Therefore, 


x' = F 


-1 



- q, 


(9) 


where F is the inverse function of F(-). Eq. ([^ shows that a higher disposal cost, —s, implies 
a lower threshold for x' above. 


2. Lemma [2 implies that higher values of initial assets, x and y or the net worth ^ = x + y, will yield 
a higher expected revenue G{q,x,y). Further, for any assets {x,y) there is a unique optimal order 
quantity q* such that q*{x,y) = argmax^>QG((?, x, j/). 

We next define the critical values, a and /3, as follows: 

a = F-i(a); (10) 

/3 = F-\b), (11) 


where 

_ p - c - {!+£) ^ ^ _ p - c - (l + i) 
p — s ’ p — s 

It is readily seen that a < b, since 0 < i < i hy assumption. This implies that a < j3, since F~^{z) is 
increasing in z. The critical value /? can be interpreted as the optimal order quantity for the classical 
firm problem corresponding to the case of sufficiently large Y of our model, in which case no loan is 
involved, but the unit “price” c • (1 -I- *) has been inflated to reflect the opportunity cost of cash not 
invested in the bank at an interest rate i. Similarly, a can be interpreted as the optimal order quantity 
for the classical firm problem corresponding to the case F = 0 of our model, i.e., all units are purchased 
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by a loan at an interest rate t. 


Note also that in contrast to the classical firm model, the critical values a and /3 above, are now functions 
of the corresponding interest rates and represent opportunity costs that take into account the value of 
time using the interest factors 1 + i and 1 + £. 


We next provide the following theorem regarding the optimality of the (a, (3) policy. 
Theorem 1. For any given initial inventory-capital state {x,y), the optimal order quantity is 


q*{x,y) 


W-x)+, l3<x-\-y- 

y+, a<x + y<l3-, 

{a — a;)’*', x y < a, 


( 12 ) 


where a and /3 are given by Eq. (10) and m respectively. 


Note that the optimal ordering quantity in the classical newsvendor model [cf. 
others], can be obtained from Theorem as the solution for the extreme case 
case the optimal order quantity is given by: 


Zipkin (2000) and many 


with i = £ = 0, in which 


a = (3 = F ^ 



Next we elucidate the structure of the {a, (3) optimal policy below where we discuss the utilization level 
of the initially available capital Y. 

1. Over-utilization: When x -I- y < a, it is optimal to order q* = a — x = y-\-{a — x — y). In this 
case y = Yjc units are bought using all the available fund Y and the remaining {a — x — y) units 
are bought using a loan of size: c • {a — x — y). 

2. Full-utilization: When a < x -I- y < /3, it is optimal to order q* = y = Y/c with all the available 
fund Y. In this case, no deposit and no loan are involved. 

3. Under-utilization: When x + y > /?, it is optimal to order q* = {f3 — x)'^. In particular, if x < /3, 
it is optimal to order f3 — x using c-{j3 — x) units of the available cash T, and deposit the remaining 
cash to earn interest. However, if x > /3, then q* = 0, i.e., it is optimal not to order any units and 
deposit all the amount of Y to earn interest. 

The above interpretation is illustrated in Figure for the case x = 0, which plots the optimal order 
quantity q* as a function of y. Note that for y £ (0, a) there is over utilization of y; for y £ [a, (3) there 
is full utilization of y and for y £ [/3,oo) there is under utilization of y. 

In light of aforementioned (a,/3) policy, one can derive the optimal expected net worth, V{x,y) = 
maXg>o G{q, x, y) in explicit form. 


Theorem 2. For the single-period problem with initial state (x, y), 
i) V(x,y) is given by 


U(x,y) = < 


p - X - {p - s) ■ r(x) + c • y • (1 + i), 
p- (3- {p- s) ■ T{I3) + c • (x + y - ^)(1 + i), 
p • (x + y+) - (p - s) • T(x + y+), 
p • a - (p - s) • T{a) + c • (x + y - a)(l + I), 


x> 13; 

X < (3, /3 < X -\- y; 
a < X 3- y < P; 

X + y < a, 


where T{x) = f^ix — t)f{t)dt; 

ii) The function V(x,y) is increasing in x and y, and jointly concave in (x,y), for x,y > 0. 


( 13 ) 









g’(o,y) 



Figure 1: The Optimal Order Quantity when a: = 0 


From an investment perspective, it is of interest to consider the possibility of speculation; cf. irnni 
(2002). The following result shows that the (a,/3) policy given in Theorem yields positive value with 
zero investment. Specifically, when the firm has zero initial inventory and capital, i.e., a; = 0 and y = 0, 
the optimal policy yields a positive expected final asset value. 

Corollary 1. For x = 0 and y = 0, one has 

y(o,o) = (p —s) / t-f{t)dt>o. 

Jo 

Note that arbitrage usually means that it is possible to have a positive profit for any realized demand 


(i.e., of a risk-free profit at zero cost; cf. Hull (2002)), thus the above speculation possibility does not in 
general imply an arbitrage, which only exists if the demand is constant. 


5 Optimal Solution for the Multiple Period Problem 


For ease of exposition, we shall denote Cn = + Vn and take z„ = -I- as the decision variable, 

in lieu of Here, Zn refers to the available inventory after replenishment, and it is constrained by 
Zn > Xn > 0 for each period n. In this fashion, the MDP model defined by Eqs. (§-§ can be presented 
as: 

K(a;„, 2 /„) = max (14) 

Zn^Xn 

where Gnizm^n) = E \Vn+i(xn+i,yn+i)\- The inventory-capital states are dynamically updated as 


^n+1 

Z/n+l 


[Zn-D^] + - 

Pn ' ~ {Pn T ^n) ~ G^n] + C„ • (^„ 


Zn) 


(1 + *n)l{2„<5„} + (1 + ^n)l{z„>{„} 


(15) 

(16) 


where = p„/c„+i, /i'„ = hnicn+i and c'„ = c„/c„+i. 

We first present the following result. 

Lemma 2. For n G ^, the following is true: 

(1) Gn{zn,Xn,yn) is increasing in and yn, and is concave in Zn, and yn 

(2) Vn{xn,yn) is increasing and concave in and yn- 


We next present and prove the main result of this section. 
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Theorem 3. (The (a„, fin) ordering policy). 

For every period n G with state {x^Vn) at the beginning of the period, there exist positive constants 
oin = Oinixmyn) and fin = fin{xn,yn) with a„ < /?„, which give rise to the optimal order quantity as 
follows: 


{.fin Xnf~^, fn ^ f^ni 

Qn{a^nT Vn) — ^ On ^ fn ^ fini 

{On Xnf~^, fn ^ On- 

Further, an is uniquely identified by 


E 


Y dVn+l ^ , j,, -.dVn+l 

- {Pn + K)-^ - 

_\oa:„+i oVn+i 

and fin is uniquely identified by 


E 


dVn+l .dVn+1 


dx. 


n+1 


“ {p'n + h'n) 


dy, 


n+1 


4 c<„>d„} 


'-{0r,>D„} 


= K(1 +^n) -K]E 


= K(l + *n)-YjE 


dVn 


+ 1 


dy, 


n+1 


dVr 


n+1 


dy. 


n+1 


(17) 


(18) 


(19) 


where the expectations are taken with respect to Dn conditionally on the initial state (x„,?/„). 


Theorem [^establishes that the optimal ordering policy is characterized by two threshold variables. More 
importantly, these two threshold values, an and +, can be obtained recursively by solving the implicit 
equations, Eqs. ([I^ and (191, respectively. 


Remark. The study in Chao et al. (2008) assumes that borrowing is not allowed, and thus the hrm 
is firmly limited to order at most ?/„ units for period n. In that paper, it was shown that the optimal 
policy is determined in each period by one critical value. Our results presented in Theorem subsume 
that study as a special case. This can be seen if we set £„ to be sufficiently large such that a loan is 
financially prohibited. In this case, becomes zero and + can be interpreted as the critical value 
developed in Chao et al. (2008). 


Corollary 2. For any period n < N and its initial state {xn,yn), the threshold variables of an and 
fn are only determined by the total worth + = x„ + yn, i.e., they are of the form: an = Oinffn) and 
fn = fnifn)- But for the last period N, um and /3 n are independent of either xn or y^. 


Not surprisingly, Corollary implies that the operational decisions are affected by the firm’s current 
financial status. In view of Corollary [^ one can first compute and /?„ at the beginning of the period 
based on the total worth +. The decision on the order quantity can then be made via Eq. 0- 


6 Myopic Policies and Bounds Analysis 

As shown by Theorem [^ the computation of a„ and + is complex and costly. This fact motivates the 
study to follow myopic ordering policies that are relatively simple to implement. Such myopic policies 
optimize a given objective function with respect to any single period and ignore multi-period interactions 
and cumulative effects. To this end, we introduce two types of myopic policies. Specifically, myopic pol¬ 
icy (I) assumes the associated cost for the leftover inventory is only the holding cost, i.e., = —/i„. 

Myopic policy (II) assumes that the leftover inventory cost s„ is not only the holding cost but it also 
includes its value in the following period, i.e., s„ = Cn+i — hn- In the following two subsections, we will 
show that myopic policy (I) yields lower bounds, and fi^ for the two threshold values, and fin, 
while myopic policy (II) yields upper bounds, and +. 

Before presenting the myopic policies, we present the following lemma that will be applied to derive the 
upper and lower bounds. 
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Lemma 3. For real functions f{x) and g(x), 

(a) if both f{x) and g(x) are monotonically increasing or decreasing, then 

E[f{X)-giX)]>E[f{X)]-E[g{X)], 

where the expectation is taken with respect to the random variable X. 

(b) If f{x) is increasing (decreasing), while g(x) is decreasing (increasing), then 

E[f{X)-g{X)]<E[f{X)\-E[g{X)\. 

6.1 Myopic Policy (I) and Lower Bounds for and (On 

Myopic policy (I) is the one period optimal policy obtained when we change the periodic cost structure 
by assuming that only the holding cost is assessed for any leftover inventory i.e., we assume the following 
modified “salvage value” cost structure: 

_ J -hn, n < N, 

Is, n = N. 


Let further, 


On 

Pn ‘ (1 ^n) ^ 

Pn ~ 

(20) 

kn 

Pn ‘ (1 “1“ ^n) 

Pn ~ Sn 

(21) 

and the corresponding critical values are 

respectively given by 




(22) 


Pn = PnHhn)- 

(23) 


For n € c/F, the order quantity below defines the myopic policy (I): 

(yn)+, Qin < Xn + Vn < 

QLn Xn-) Xn “t“ yn ^ tfn’ 

The next theorem establishes the lower bound properties of the myopic policy (I). 


Theorem 4. The following are true: 

i) For the last period N, and /On = (3 

a) For any period n = 1,2,... N — 1, an > an Pn > 


6.2 Myopic Policy (II) and Upper Bounds for and (On 

Myopic policy (II) is the one period optimal policy obtained when we change the periodic cost structure 
by assuming that not only the holding cost is assessed but also the cost in the next period for any leftover 
inventory i.e., we assume the following modified “salvage value” cost structure: 


f ^n+l hn, n < N, 
( s, n = N. 


(24) 


One can interpret the modified salvage values of Eq. (241 as representing a fictitious income from 
inventory liquidation (or pre-salvage at full current cost) at the beginning of the next period n+ 1, i.e., 
it corresponds to the situation that the firm can salvage inventory at the price Cn+i at the beginning of 
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the period n + 1. Note that the condition c„(l + £„) + > c„+i is required if inventory liquidation 

is allowed. Otherwise, the firm will stock up at an infinite level and sell them off at the beginning of 
period n + 1. Such speculation is precluded by the aforementioned condition. Let further, 


_ Pn “h ^n] 

— _ ? 

(25) 

Pn 


^ Pn-Cn[l + in] 

— 

(26) 

Pn Sn 


and the corresponding critical values are given by 


^n — 

(27) 

Pn = Fn^{K). 

(28) 


For n € c/F, the order quantity below defines the myopic policy (II): 


{Pn “t” Vn ^ Pn] 

Qn(^n;?/n) — ^ ^ yn ^ l^rn 

“f Vn ^ ^n- 


Let V^{xn,yn) denote the optimal expected future value when the inventory liquidation option is avail¬ 
able only at the beginning of period n -|- 1 (but not in the remaining periods n -I- 2,..., N) given the 
initial state (a;„, yn) of period n. For notational simplicity, let ^n-i-i = ^n+iixn, Vn, Zn, Dn) represent the 
total capital and inventory asset value in period n -I- 1 when the firm orders > a;„ in state (a;„, j/„) 
and the demand is Dn- Note that ^„+i = x„+i -f where Xn+i and yn+i are given by Eqs. © and 
(16), respectively. Therefore, Vn can be written as 


Vn {Xn, yn) — 


max E [K-i-i(0,Cn+i) I a^n,2/r7 

Zn'>Xn 


(29) 


Note that for any real functions g{x) and f{x), with g{x) increasing and concave in x and /(x) concave 
in X, the function g(^f(x)) is concave in x € IR. Thus, the concavity of E [y„_|_i(0,^„+i) |x„,?/„] in 
follows from the observations that 1^(0,^) is increasing and concave in ^ (cf. part 2 of Lemma and 
is concave in in since both x„+i and yn+i are concave in Zn (cf. discussion in the proof of 
Lemma regarding the second order derivatives of x„+i and yn+i with respect to Zn)- Therefore, V^ 
has an optimal policy characterized by a sequence of threshold value pairs, {an,/3n)- 
Before exhibiting the upper bounds of and /3„, we present the following result. 

Proposition 1. For any period n with initial state {xn,yn), 

(i) Vn(xn — d, yn + d) is increasing in d where 0 < d < x„. 

(a) The partial derivatives satisfy, dVn{xn,yn)/dyn > 9Fn(x„, y„)/9x„. 

Part (i) of Propositionstates that, for the same total asset, more capital is more profitable than more 
inventory. This is true because more capital provides more flexibility of converting cash into product. 
Part (ii) implies that the contribution margin of a unit of cash is higher than that of a unit of inventory. 
In view of Proposition we have the following results. 

Proposition 2. For any state (x„, ?/„), and all n = 1,... N, the following are true: 

('^) i^n^yn) F Vn{Xn,yn) y 
(a) > an and > Pn ■ 

Note that inventory liquidation at the beginning of period n -|- 1 provides the firm with additional 
flexibility, since the initial inventory Xn+i can be liquidated into cash, thereby allowing the firm to holds 
only = x„_|_i -f yn+i in cash. Note further that the firm will chose to stock up to a higher level of 
inventory when liquidation is allowed. Indeed, if the firm orders more in period n, all leftover inventory 
after satisfying the period demand Dn can be salvaged at full cost Cn+i at the beginning of the next 
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period, n + 1. In other words, the firm will take the advantage of inventory liquidation to stock product 
at a higher level than that corresponding to the case in which liquidation is not allowed in the current 
period n. The advantage of doing so is twofold: (1) more demand can be satisfied leading to more 
revenue, and (2) no extra cost is accrued from liquidation of leftover inventory. 

The next result establishes the upper bound properties of the myopic policy (II). 


Proposition 3. For any period n = 1,2,... — 1, if c„(l + £„) + > Cn+i, then the threshold 

cons t ants of the optimal policy given in Eqs. (18)-(19} and its myopic optimal policy given in Eqs. 
(21)-(28) satisfy d„ > an and Pn > /3n- 
For the last period N, = cxn o-nd = Pm- 


6.3 An Algorithm to Compute {amfin) 

It is generally not easy to compute solutions even for the simpler multi-period problems which involve 
base-stock levels. In the supply chain literature, computational methods are often based on heuristic 
algorithms or iterative search procedures. Determination of base-stock levels in each period or for each 
echelon and the minimization of the total supply chain cost are notoriously complex and computationally 
tedious, especially for our underlying two-dimensional state space with the attending curse of dimen- 


sionality; cf. 

Lee and Billington 

1993) 

Chen and Zheng 

(1994) 

Minner 

(1997) 

Shang and Song 

(2003) 

and 

Daniel and Rajendran 

(200e 

I- 


Nevertheless, with the aid of the lower and the upper bounds developed in (6.1 and §6.2[ respectively, 
we develop an efficient algorithm for the problem herein, using bisection. In view of Theoremfor each 
period n G A' we aim to find the roots of </>(«„) = 0 and ip{Pn) = 0, where 


Pian) ■■= E 


/ dVn+l 
\dXn+l 


(P'n + 


dyn+1) 




+ t-n) 


K]E 


514 ,- 1-1 

dyn+i 


(30) 


is the first-order derivative of Gn{zn,Xn,yn) w.r.t. Zn at Zn = «« for a period in which the firm took a 
loan; and 


'f’niPn) ■= E 


( dVn+l 

V5a:„+i 


{Pn + 


514-1-1 \ 

dyn+1) 




[On(l + 4) 


K]E 


514+1 

5yn+i 


(31) 


is the first-order derivative of Gnizn,Xn,yn) w.r.t. Zn at Zn = Pn for a period in which the firm made a 
deposit. 


Threshold Computation Algorithm: 


STEP 0 

STEP 1 
STEP 2 


STEP 3(a) 


Determine and discretize the state space of elements a; G X and y G Y; 
Specify the tolerance e > 0; 


For the last period n 


N and 'i(x,y) G X x Y, compute VN(x,y) using Eq. 


(131; 


Set the period index n n — 1; 
Compute q„ and /5 using Eqs. 
Compute d„ and using Eqs. 


( 22 ) 

(27i 


-(23); 

-(2Sl; 


To compute a„: Set a ^ b a„; 

While b — a > e 

Set c +- {a + b)/2 

If <t>n{c) = 0 or (b — a)/2 < e 

Display “solution found”; Output(a„ = c); Stop 
End If 

If pnic) > 0, then a •<— c; else b c. 

End While; go to STEP 3(b) to compute l3„. 
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STEP 3(b) 


To compute /3„: Set a <— /3 , 6 /3„; 

While b — a > e 

Set c (a + b)/2 

If ipn{c) = 0 or {b — a)/2 < e 

Display “solution found”; Output(/3„ = c); Stop 
End If 

If ipnic) > 0, then a c; else b c. 

End While; go to STEP 4. 


STEP 4 


Compute the optimal order quantity using Eq. (17| for each state; 
Compute V„{x„,yn) by substituting qn{xn,yn) intoE [P„+i(a;„+i, i/„+i)]; 
If n > 1, go back to STEP 2; Otherwise END. 


We now discuss briefly the complexity of the bisection search algorithm above. This method is guaranteed 
to converge to the roots of </)„(«„) and ipnifin), since (pni^n) — 0 while 4'n{^n) < 0; and > 0 

while ipniPn) < 0. Specifically, if Ck is the midpoint of the interval in the fc-th iteration of STEP 

3, then the difference between Ck and a solution c, i.e., or /3„, is bounded by Icfe — cl < —-—. 

2 " 

Therefore, the number of iterations k to attain a predetermined error (or tolerance) e is given by, 
k = log 2 (y) = Sg~ 2 °^ ’ where eg is the range of bounds; viz. eg = — a„ for computing a„, and 

eo = Pn- for computing /3„. 

6.4 Selling Back to the Supplier: Upper Bound for the Value Function 

Vn{x,y) 

The myopic policies above provide lower and upper bounds for and j5n, respectively, and both of 
them provide lower bounds for the value function Vn{x,y). In this section we obtain upper bounds for 
the value function by considering a related problem in which the firm is given the option to sell unneeded 
inventory back to the supplier at full price. Thus, for some cases, the Arm has more flexibility at the 
beginning of a period n S jy to readjust the inventory level as compared to just ordering from the 
supplier at cost c„. For example, the Arm is allowed to sell unneeded inventory back to the supplier or 
at a free-trading spot market at price c„. We assume c„_|_i < c„ -I- to preclude situations that the 
firm can profit from selling product in inventory back to the supplier. 


In practice this situation occurs either when there is an agreement between the supplier and the firm 
such as a vendor-managed inventory (VMI) contract, or there is a commodity spot market, e.g., energy 
sources and natural resources; cf. Secomandi (20101. We will refer to such a setting as a selling back 


option. The selling back provides the firm with the flexibility to liquidate any excess inventory into cash 
prior to the regular selling season. This technically reduces the state of the system from two variables, 
Xn and to a single variable that represents the sum of the cash value of the on-hand inventory 
plus the cash value, expressed in product units, i.e., = Xn + Vn- 

Adding Eqs. (15) and (16) yields the dynamics equations for = Xn+i -f yn+i, with the decision 
variables 


Cn+l Pn ' {Pn A -^n] “b 


(1 + *n)l{z„<5„} + (1 + U)l{z„>{„} 


The dynamic programming equations for the value function V^(^n) are 

U^(e„)=maxE[F4i(e„+i)], 

Zn>0 

where the terminal value V^{^n) = Uv(0,^jv) is given by Eq. (^. 


(32) 


(33) 


It is straightforward to show that is increasing and concave in ^ for any n £ ./E. Consequently, 

we have the following result. 
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Theorem 5. (Optimal inventory-trading policy with selling back). 

At the beginning of period n € c/K, if the firm has a selling back option, then 

(i) The optimal policy is (a^, (3^) policy, where 0 < of < Pn- That is, the optimal target inventory is 

r /3^, Cn>/3f; 

4(?n) = I a^<in< Pn', 

[ of, Cn < af■ 

(ii) For any Xn and the value functions satisfy 

i^n “t“ Z/n) ^ i^niVn') ^ UnP 


Theorem states that, with the selling back option, the firm can freely reposition its inventory via 
selling down or ordering up as follows. If then it is optimal to choose the target inventory 

equal to /3f; if fn < af, then it is optimal to choose the target inventory Zn as of; and otherwise, if 
< in < Pn: then it is optimal to choose the target inventory equal to 
Note that I/f provides an upper bound for 14, which is easier to compute than that of Vn{x,y), since 
the former is a function of only one variable. 


7 Numerical Studies 


In this section, we present numerical studies to glean further insights into the interplay between cash flow 
and inventory flow. To this end, we fix the following parameters across periods: the selling price p = 2000; 
the ordering cost c = 1000; the holding cost h = 500; the deposit interest rate r = 1%; and the loan 


interest rate £ = 15%. The salvage value s = 600. In the sequel. Subsection |7.1| considers the impacts of 
time horizon and initial states on the optimal solution; Subsection |7.2| studies the corresponding impact 
of various demand distributions, and Subsection [7?^ investigates the performance of the lower and upper 
bounds of the value function. 


7.1 Impact of Time Horizon 

We assume that the demand is uniformly distributed as D ^ U[0, 20] and select N = 3 and = 6 as 
time horizions. The solution Vi{x,y), is generally obtained by backward induction using the numer¬ 
ical algorithm as presented in 1 |6.3[ and to emphasize the dependence of Vi{x,y) on N we will write 
Vi:N{x,y). Figure [^depicts the resultant optimal functions Vi:N{x,y) for the two selected time horizons 
and states (x, y) with x ranging from 0 to 20 and y ranging from -50 to 50. 

Observe first that Vi-,Nix,y) in Figure]^ is increasing and jointly concave in x and y. This observation 
comports with Lemma 

Further, the top-right of Figureshows that Vi.,N{x,y) is increasing in N for large values of x and/or 
y; however, the far bottom-left of that hgure shows that for sufficiently small x and/or y, Vi.,M{x,y) is 
decreasing in N. For cases of sufficiently large or small y, the optimal value is primarily determined by 
financial decisions as apposed to operational ones, e.g., there is a large cost due to loans for sufficiently 
negative y, and consequently, Vi,Q[x,y) is smaller than Vi,^{x,y). The opposite is true for sufficiently 
large y. Conversely, the middle segment of that figure shows that for non-extreme values in the range of x 
and y, the operational decisions play a more important role than the financial ones, yielding signihcantly 
larger magnitudes of Vi:i<iix,y) over the time horizon N. The dominant role of operational decisions is 
supported by the observation that the rate of increase of Vi.,N{x,y) in y is increasing in N. 

7.2 Impact of Demand Distributions 

In the sequel, we fixed the time horizon as N = 6. To study the impact of demand distributions, we hrst 
consider various uniform demand distributions with the same mean but different variance. Figures[^and 
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[^depict Vi{x, 0) and Vi(0, y) respectively for D ~ IA[Q, 20] , Z3 ~ Z^[2,18], D ~ IA[A, 16] and D ^ f^[6,14]. 
Both figures show concavity for each demand type. Given the common mean, the demand variance has 
a significant impact on the value function. For example, there is roughly 5,000 reduction from the case 
oi D U[&, 14] to the case of H ^ U[A, 16] for any a: or y in each figure. 

We next consider the impact of different types of demand distributions in addition to the uniform 
distribution. The Zero-Inflated Poisson {ZTV) distribution is a useful generalization of the Poisson 
distribution; cf Lambert (1992). The ZIP distribution with parameters tt € [0,1) and A > 0 has the 
following probability mass function: P(Af = 0) = tt + (1 — 7r)e“''' and P(X = k) = {1 — TT)e~^X^/k\ for 
k = 1,2,3.... Hence, its mean yx = A(1 — tt) and its standard deviation ax = \/A(l — 7r)(l + Att). 
Therefore, its coefficient of variation (defined as the ratio between the standard deviation and the mean) 


IS c.v. = 


I+Att 
A( l-7r) ■ 


Figure [^compares the optimal Vi{x,y) with D ^ ZIV{0.18, 10) and D ~ fY[0,20], both of which have 
the same c.v. — 0.58. It shows that the uniform demand yields higher Vi{x,y) than the ZXV demand 
for any x and y. This can be explained by the mean of the uniform demand (/i = 10) being larger than 
that of the ZIV demand (/i = 8.2), even though they have the same c.v. 


Figure 2: Function Vi{x,y) for = 6 and N = 3 Figure 3: Function Vi(a:, 0) for = 6 with Se- 
with D 20] lected Uniform Demand Distributions 



Figure 4: Function Ui(0,y) for A^ = 6 with Se- Figure 5: Vi{x^y) for N = 6: Uniform v.s. ZIP 
lected Uniform Demand Distributions Demand Distributions 




Table displays the the optimal objective function values and the performances of myopic policies (I) 
and (II), in terms of uniform and ZIP demands with respect to different c.v. levels. In the table, for 
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Xi = yi = 0, Vi := Vi(0, 0), is the expected wealth under myopic policy (^), ^ € {/,//}, and 

the performance gap percentage := (Vi — x 100%. First, as c.v. decreases, the value 

of Vi(0,0) increases significantly for each type of demands. Second, under the uniform demand, myopic 
policy (II) with < 0.2% performs significantly better than myopic policy (I) with > 3.5%; 

but the converse is observed under the ZXV demand. For the same c.v. value, ZXV demand has lower Vi 
than Uniform demand; this can be explained by the smaller mean of ZXV demand, and the significantly 
higher probability of zero demand, e.g., when c.v. = 0.46, ¥{D = 0) = 9% for ZIV demand, but 
P(ZI = 0) = 0% for the Uniform demand. Finally, note that for the last row in Table Z2V(0, 10) 
is the standard Poisson distribution with mean A = 10 - the same mean as ~ U{Q,\4). However, 
ZI'P{0, 10) has a smaller Vi, because it has a larger standard deviation, and hence a higher c.v. value. 


Table 1: The Optimal v.s. Myopic Policies: Uniform and ZIP Demand with Various c.v. {xi = = 0 

and N = 6) 





D ~ U[a 

,b] 





D ^ 





C.V. 


Optimal 

Myopic I 

Myopic II 

C.V. 

Optimal 

Myopic I 

Myopic II 

[a, b] 

Vi 

vy) 

A<^)% 

vyn 

a(")% 

(tt. A) 

Vi 

vy) 

a(^)% 

vyn 


0.58 

[0, 20] 

35074 

30271 

13.69% 

35016 

0.16% 

0.58 

(0.18. 10) 

23130 

22800 

1.43% 

21757 

5.94% 

0.46 

[2.18] 

40174 

36784 

8.44% 

40158 

0.04% 

0.45 

(0.09. 10) 

26920 

26910 

0.04% 

26142 

2.89% 

0.35 

[4.16] 

44950 

42329 

5.83% 

44886 

0.14% 

0.35 

(0.02, 10) 

29612 

29484 

0.43% 

29115 

1.68% 

0.23 

[6.14] 

49428 

47677 

3.54% 

49385 

0.09% 

0.31 

(0. 10) 

30355 

30288 

0.22% 

29911 

1.46% 


Figure 6: Vi'®(5) v.s. Vi(0,y) and Ui(a:,0) for Figure 7: Function Vf{^) for N = I, 2,4,6 with 
N = 6with D r^U[0,20] Dr^U[0,20] 




7.3 Upper and Lower Bounds of the Value Function 

As discussed in we know that each of the myopic policies provides a lower bound for the value 
function, hence we can take the larger one as the better lower bound. Furthermore, Vi provides an 
upper bound. In what follows, we numerically examine their approximating performance with the same 
parameters as the ones selected in the previous numerical studies. 

Figure compares with Ui(^,0) and Vi(0,^) for N = 6. First, for any it is shown that 

Fi'^(C) ^ Fi(0,^) > Vi(^, 0). Second, the difference between Vf{^) and Vi(0,^) is almost imperceptible 
which implies that the upper bound is fairly tight for the state of high capital level y (or low product 
level x). Further, the bound gap between U'^(5) and Ui(C, 0) gets larger as ^ increases. 

Figure in depicts the effect of N on for N = 1,2,4, 6. Observe that for any N, Uifjv(0 is 

increasing and jointly concave in Further, referring to the top-right of Figure]^ is increasing 

in N for large values of e.g., ^ > 10; however, referring to the far bottom-left of the figure, l/jf^(^) is 
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decreasing in N for sufficiently small e.g., ^ < —30. Finally, we conclude that operational decisions 
plays a more important role than the financial decision for the middle range of e.g., ^ S (—30,10), 
since the slope at each N in the interval is significantly larger than elsewhere, and gets larger as N 
increases. 

Tableexhibits the optimal value function (Opt.) and its lower and upper bounds for D ~ Z^[0, 20] and 
D ~ Z^[6, 14], iV = 6, 12 and selected product level state x = 0,7,14. In this case, the lower bound 
is obtained from myopic policy (II) since it performs better than myopic policy (I). First, each bound 
provides a fairly tight approximation for the optimal value with less than 1%. Second, as c.v. 

of demand distribution decreases from 7/[0,20] to U[6, 14], the optimal value function and its lower and 
upper bounds increase, due to the reduced volatility of the demand. Further, the lower bound gap 
gets smaller, while this change is not evident for its upper bound gap . Third, for each N and each 
demand distribution, as x increases, the bound gap A^ gets larger, whereas this behavior is not evident 
for A^^^\ Finally, as the time horizon N gets longer, the optimal value function and its lower and upper 
bounds get larger, and the bound gap A^^^ gets larger as well for both bounds S {//, S}. However, 
the change of the corresponding gap percentage A^^'>% is not evident. 


Table 2: The Lower and Upper Bounds for the Value Function Vi{x, 0) 






D 

' ~ W[0.20] 






D 

~ U[6, 14] 






Opt. 

LowerBound 

UpperBound 

Opt. 

LowerBound 

UpperBound 

N 

X 

Vi 


A<") 

A<")% 

vf 

AS 

0 

Vi 

vyn 

A<") 

A(")% 

vf 

A® 

AS% 


0 

35074 

35016 

58 

0.16% 

35080 

-6 

-0.02% 

49428 

49386 

43 

0.09% 

49428 

0 

0.00% 

6 

7 

45542 

45435 

107 

0.24% 

45550 

-9 

-0.02% 

58575 

58536 

39 

0.07% 

58575 

0 

0.00% 


14 

54248 

54200 

48 

0.09% 

54355 

-107 

-0.20% 

66076 

66036 

40 

0.06% 

66634 

-558 

-0.84% 


0 

75888 

75693 

194 

0.26% 

75923 

-36 

-0.05% 

103872 

103760 

112 

0.11% 

103872 

0 

0.00% 

12 

7 

87273 

87057 

216 

0.25% 

87290 

-18 

-0.02% 

113564 

113464 

100 

0.09% 

113564 

0 

0.00% 


14 

96528 

96410 

118 

0.12% 

96660 

-132 

-0.14% 

121521 

121419 

102 

0.08% 

122114 

-592 

-0.49% 


8 Model Extensions 

In this section, we study three extensions of the basic model. The first extension is a piecewise linear 
structure of the interest rate functions for both loans and deposits, the second is the existence of a 
maximum loan limit and the third is backorder of unmet demand. 

8.1 Piecewise Type of Loan and Deposit Fnnctions 

So far, the loan function was assumed to be a linear function: L{x) = {1 + £) ■ x with a constant loan 
rate £. However, L{x) can have a more complex form in practice. In this section we investigate the often 
occurring case in which L(x) is a piecewise linear function, i.e., it has the form, 

L{x) = {l + i^”^'>)-x, X G 

where x(°) = 0 and for m = 1,2,3,.... 

Similarly, we consider the deposit interest function to be a piecewise linear function of the form, 

M(y) = (l + *W).y, yG(y('=-i),yW], 


where = 0 and for fc = 1, 2,3,.... 

Without loss of generality, we assume that the loan interest rates are always greater than the deposit 
interest rates, that is i < where i = sup;.{*^^^}. 
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Before characterizing the optimal ordering policy, we introduce the threshold values of and for 
m,k = 1, 2, 3,... as follows 


a(™) = 

pik) ^ 


(34) 

(35) 


where 


jW = P-c - (1 + ^^"^^) . ^(fc) ^ p-c - (l + jW) 
p — s ’ p — s 

It is straightforward to see that 

pW >... p(k) > ^(fc+ 1 )... > ^ > > ... • • • > 0 , 

— p — C*(l“hz) 

where (3 = F~{ -). We present the structure of the optimal ordering policy in Theorem 

p — s 

below. 

Theorem 6. For any given initial inventory-capital state {x,y), the optimal order quantity is 

(/3W_^)+, /?('=+!)< x + y < 

’ ’ * 1 

(y)+, < X + y < P] 

’ ’ * 1 

(a^™) — a;)+, <xFy< 


q*{x,y) = < 


where and are given hy Eqs. {34) and (35), respectively. 

For the multi-period problem, the optimal order quantity for each period has a structure similar to that 
of its single period counerpart, and the proof is analogous to that of Theorem We shall note that for 
period n < N, the threshold values, and are determined by However, for the last period 
N, the threshold values, and are independent of the initial state xn and y^, or ^at. We shall 
mention that if the lender charges a high loan rate such that p < c • (1 -I- i)"^)] for loan amount larger 
than x^'^~^), then = 0 via Eq. (34), since is nonpositive. In view of Theorem]^ if the total 
asset a: -|- p < 0, then the firm will not order via a loan. 


8.2 Financing Subject to a Maximum Loan Limit Constraint 

In practice, the outstanding loan amount is often restricted not to exceed a maximum limit. Let > 0 
denote the maximum loan limit for period n; hence the maximum loan can finance finance := L„/c„ 
units of the product. In this case, we have the following structural results for the optimal ordering policy. 


Theorem 7. (Optimal ordering policy under a maximum loan limit). 

For period n G with given state {xn,yn) at the beginning of the period, if there is a loan limit Ln, 
then there exist positive constants afl = and (dfl = (3n{£,n) with < /3n: which characterize the 

optimal order quantity as follows: 


Wu-Xn)+, 


F yn F. Pn ! 


q*{Xn,yn) = < 


(2/n) + , 

{afi - Xn)+, 


Q-n ^ Xn + yn < Pn'^ 

Q-n - L'n <Xn + yn< ) 


L( 


Xn F yn F Oyj ^n' 


Note that for period n, the inequality is admissible. In this case, the maximum loan limit is 

not binding since the optimal order quantity satisfies <?* < F L'^. 


19 














8.3 Backorder System 

Recall that our basic model assumes the lost-sale rule for unmet demand. This section considers the 
case in which backorders are allowed and shows that an ordering policy of the same (an,/3„) structure 
is optimal. 

Suppose that any unmet demand is backlogged subject to penalty cost per unit of unmet demand. Let 
Vn{x, y) denote the optimal expected profit function of period n for given initial state (x, y). Accordingly, 
we have the following dynamic programming formulation: 


Vn{Xn,yn)= SUp E 

Zn^Xn 


Vn-\-l t ^n+l) | Vn 


n=l,2,--- ,N -1 


where the expectation is taken with respect to and Xn+i, yn+i are respectively given by 

yn+1 — T ^n)]/Cn-t-lj 


and 


^n) — {Pn T ‘ {Pn “t” “t” l>n) [^n ^n] 

^n) — Cyj * Zn) [(1 “t“ ^n)^{Zn<^n} A (1 “t“ ^n)'^{Zn.>^n}'\ ■ 


(36) 


(37) 

(38) 


(39) 

(40) 


For the terminal period N, VN{xN,yis[) = sup„^>qE 


Rn{Dn, zm) + Kn{zn, ^n) 


, where = —s. 


Theorem 8. Under the backorder rule, for any period n G with initial state (a;„,y„), there exist 
positive constants q;„ = Q;„(^„) and Pn = Pn{f,n) satisfying an < Pn, which characterize the optimal 
order quantity as follows: 


iPn ^n) , 4“ Un ^ Pn, 

Q {.^n,yn) — ^ Pi Xn “t“ 2/n ^ Pn] 

(o^n Xn')~^, Xn T yn ^ O^n • 


(41) 


Further, an is uniquely identified by 


E 


dVr 


"+i 


~ {P'n + h'n) 




n+l 


dXn+l ^'dyn+1 

and Pn is uniquely identified by 

E 


4a„>D„} 


dVn+1 , ! , ^ 914 - 1-1 \ ., 

~ \Pn + ^nljG'. I ^{Pr,>D„} 


dx. 


n+l 


% 


n+l 


= [c'„(l + +) -p'JE 


= [c'„(l + 4) -p)i]E 


dVz 


n+l 


dy, 


n+l 


dVr 


n+l 


dy, 


'n+l 


(42) 


(43) 


where the expectations are taken with respect to conditionally on the initial state (x„,?/„). 


9 Concluding Remarks 

In this paper, we studied the optimal operational-financial policy for a single-item inventory system 
that adimitted both interest-bearing loans and interest-earning deposits. We showed that the optimal 
ordering policy, called («„,+)-policy, for each period is characterized by two threshold variables, we 
presented two myopic policies which provided each a lower and upper bound for the threshold variables. 
The two bounds were then employed to develop an algorithm to compute the two threshold values, 
an and /3„. The two myopic policies provided lower bounds of the value function. However, we further 
introduced an upper bound for the value function via assuming that the firm can sell unneeded inventory 
back to the supplier. 
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The results of this paper directly suggest several directions for further research. These include i) addition 
of a fixed ordering cost and/or a fixed financial transaction cost; ii) addition of a fixed system operating 
cost proportional to the elapsed time; and iii) incorporation of bankruptcy risk. Our study assumes risk 
neutral decision making. It would be of interest to analyze the risk-induced performance of the system, 
e.g., credit rollover risk and bankruptcy probabilities; cf. Babich et al. (2012), Gong et al. (2014) and 


Li et al. (2013). 
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10 Appendix 

Proof of Lemma The continuity follows immediately from Eq. 0 - We next prove the concavity via 
examining its first-order and second-order derivatives. To this end, differentiating Eq. 0 via Leibniz’s 
integral rule yields 


d_ 

dq 


G{q,x,y) = 


p — c - {1 + i) — {p — s)F{q + x) 
p - c ■ (1 + £) - {p - s)F{q -I- x) 


if 9 < y, 
iiq> y. 


Therefore, ioi q> y oi q < y 


92 


dq 


^G{q,x,y) = -{p- s)f{q + x). 


(44) 


(45) 


The concavity in q now readily follows since ^G{q,x,y) < 0 by Eq. (45). 

Although the value function is not first order and/or second order differentiable at certain points (e.g., 
at q = y), we can still consider its derivatives to show its increasing or decreasing properties, which 
allows us to study the optimal solution. Such consideration will be used throughout the paper. 

The increasing property of G{q, x, y) in x and y can be shown by taking the first order derivatives 


d_ 

dx 

d_ 

dy 


G{q,x,y) = pF{q + x) + sF{q + x) > 0, 

G{q,x,y) = c- [(1-f i)l{,<j^}-f (1-f f)l{,>j^}] > 0. 


(46) 


The joint concavity of G{q, x, y) in x and y can be established by computing the second order derivatives 
below using again Eq. ([^. 


dx'^ 

_d^ 

dxdy 


G{q,x,y) = -{p- s)f{q + x) <0, 

G(q,x,y) = 0, 


G{q,x,y) = 0. 


Thus the Hessian matrix is negative semi-definite and the proof is complete. 

Proof of Theorem]^. Part (i) follows by substituting q* given by Eq. (12) into Eq. ([^. 

Eor part (ii) the increasing property of V can be readily justified. To show the concavity of V, note that 
by Lem ma [T G{q,x,y) is concave in q, x and y. Maximizing G over q and using Proposition A.3.10 of 
Zipkin ( |2000 ), p. 436, we have that the concavity in x and y is preserved and the proof is complete. □ 


Proof of Corollary]^ The result follows readily by setting a; = y = 0 in Eq. (13). 


□ 





(a) x-iry<a 


(b) a<x-\-y<l3 


(c) x->ry> P 


Figure 8: Functional Structure for the Derivative of G{q,x,y) with Respective to q 
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Proof of Lemma We prove the result by backward induction. In particular, in each iteration, we 
will prove properties (1) and (2) by recursively repeating two steps: deducing the property of Gn from 
the property of V^+i and obtaining the property of 14, from the property of Gn- Throughout the proof, 
for a matrix or a vector w, we denote its transpose by w"’". The Hessian Matrix (if exists) of a function 
G = G{x,y) will be denoted by {x,y)- For example, the Hessian Matrix of 14+i (a;„+i,y„+i) is 
denoted by 




(47) 


1) . For Vat, we have a one period problem. In this case, the result for function Gn{zn, yN) is 
obtained by Lemmawith Zn = Xn + Qn and the result for V^ixpi^yj^) is given by Theorem]^ of the 
single period problem. 

2) . For n = 1, 2, • • • , — 1, we prove the results recursively via the following two steps: 

Step 1. We show that G'„(z„, Xm yn) is increasing in and concave in Xn and if Vn+iixn+i,yn+i) 
is increasing in yn+i and concave in Xn+i and y„+i. 

We first compute the partial derivatives that will be used in the sequel for any given Zn- By Eq. (15), 
we have: 


dx 


n+1 


dx 


n+1 


dZn 


dXn 

dXn+1 

dyn 


= 1 


{Zn>D-n} '! 


= 0 . 


(48) 

(49) 


Similarly, from Eq. (16) we obtain: 
dyn+i 


dZn 

dyn+i 

dXn 

dyn+i 

dyn 


— Pn^{zrt<Dn} ^n^{zri>Dn} '"n [ (1 T '^ri)^{zn<Xn+Vn} T (1 + ^n)l{z„>a;„+y„}] j (50) 

Pn^{zn<Dn} ^n^{zn>Dn}: (51) 

= [(1 + 4)l{z„<x„+y„} + (1 + ^n)l{ 2 „>a;„+y„}] • (52) 


Erom Eqs. (48)-(521, it readily follows that the second order derivatives of Xn+i and yn+i respect 
to Xn and are all zero. In the sequel we interchange differentiation and integration in several 
places, which can be justihed by the Lehesgue’s Dominated Convergence Theorem; cf. Bartle (1995). 
The increasing property of function G„(z„,a;„, 2 /„) in can be established by taking the first order 
derivative of Eq. ([^ with respect to ?/„. Then, we have 


o Gn^Zn-f Xn-^yn) — 1^ 

dyn 


= E 


^14-t-l (:^n+l 1 ) dXn-\-l ^ ^14-t-l (^n-t- 15 yn+ 1 ) dyn-\-l 


dXn+1 dyn 

^14-t-l(^n+lj yn-t-l) dyn+1 


dyn+i 


dyn 


dy, 


'n+1 


dyn 


> 0 , 


where the second equality holds since dxn+ijdyn = 0, by Eq. (49), and the inequality holds by Eq. (52) 
and the induction hypothesis that Vn+i is increasing in 

To prove the concavity of Gn{zn, Xn, yn) in Zn, Xn and ?/„, we compute its Hessian matrix and show that 
it is negative semi-definite. To this end, we compute the first order partial derivatives of Vn+i as. 


dGn 

dZn 

dGn 

dXn 

dGn 

dyn 


^14-t-l (:^n-t-l 7 l/n-t-l) dXn+1 ^ <914-1-1(^71-1-17 2/71-1-1) dyn+1 

dXn+1 dZn dyn+1 dZn 

d\^n+l{Xn+l-iyn+l) dXn+1 ^ <914-1-1(^71-1-17 2/71-1-1) dyn+1 

dXn+1 dXn dyn +1 dXn 

<9I4_|_i(x^_|_l, 2/71-I-1) dVn+l{Xn+lTyn+l) dyn+1 

' ' ' ' - —j- >*7 -^ '■■■■■ ~~~~ — -- 

dxn +1 dyn dyn +1 dyn 


(53) 

(54) 

(55) 
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and consequently the second order derivatives as 


d^Gn 

= E 

'dXn+l 

dyn+i' 

■ • 

dXn+l 

dyn+i' 

T' 

dZndZn 

dZn 

dZn 

dZn 

dZn 


d^Gn 

= E 

'dXn+1 

dyn+i' 


dXn+l 

dyn +1 

T~ 

dZndXn 

dZn 

dZn 

dXn 

dXn 


d^Gn 

= E 

dXn+1 

dyn +1 


dXn+1 

dyn +1 

T~ 

dzndyn 

dZn 

dZn 

dyn 

dyn 


d^Gn 

= E 

dXn+1 

dyn +1 


dXn+1 

dyn +1 

T~ 

dxyidx^ 

dXn 

dXn 

dXn 

dXn 


d^Gn 

= E 

dXn+1 

dyn +1 


dXn+1 

dyn +1 

T~ 

dxndyn 

dXn 

dXn 

dyn 

dyn 


d^Gn 

= E 

'dXn+1 

dy n+i' 


dXn+l 

dyn+i' 

T~ 

dyndyn 

dyn 

dyn 

dyn 

dyn 



where, by Eqs. (48) 
respect to and 
the Hessian matrix of G 


(52), the terms involved with the second order derivatives of Xn+i an d Vn +i with 
have vanished and where the Hessian matrix is given by Eq. (47). Thus, 

is: 


(■2'n; yn) — 


d^Gr, 

d^G„ 

9^G„ 1 

dZridZn 

dZndXn 

d^G„ 

dzjfdvn 

a G„ 

dXjidZn 

dXndXn 

d^Gn 

dxjidyn 

9^G„ 

dyndZn 

dy-n dXn 

dy„dy„ J 


(56) 


with its elements as given above. To prove it is negative semi-definite, we consider the quadratic function 
below for any real wi, W 2 and UI3, 


[wi,W 2 ,W 3 ] ■ ■ [wi,W 2 ,W 3 ]^ = E [v ■ ■ iF] , 


(57) 


where v = wi 


dx„ + l dUn + l 

dz-n ’ dz,i 


+ W2 


dx„+i dvn+i 
dXn ’ dXn 


+ W3 


9xn+i dyn+i 
dVr, ’ dy„ 


^vq+i 

is negative semi-definite, we have for any wi, W 2 and W 3 


Since by the induction hypothesis 


V ■ < 0 


and this implies that the left side of Eq. (l57| is non-positive. Thus, the proof for Step 1 is complete. 


Step 2. We show that Vn{xn,yn) is concave in {xn,yn) if Gn{Zn,Xn,yn) is concave. 

Since Gn{zn,Xn,yn) is concave in z„ and x„ and j/„, 14(x„,2/„) = G'„(z„, x„, j/„) is c oncave 

in Xn, yn by the fact that concavity is reserved under maximization; cf. Proposition A.3.10 in |Zipkin| 

( 200 ^ . 

Finally, the induction proof is complete with steps 1 and 2. □ 


Proof of Theorem]^ Given state {xn,yn) at the beginning of period n G we consider. 


r. GnFzii Xn^yn) — 0, 

OZn, 


(58) 


where 5G„(z„,x„,2/„)/9z„ is given by Eq. (53). Substituting Eqs. (48) and (50) into Eq. (53) we 
consider the following cases: 

(1) for < x„ -I- yn, 


dGn 

dZn 


= E 


^Fi+l / r -t ir-i ' /'I I ■ I 

V) ^{z„>D„} + V) \Pn^{zn<D„} ~ ^nl{2„>D„} ~ C„(l -|- *n)) \Xn, y-n 

OXn+1 Oy-n+l 


■ (59) 
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( 2 ) for Zn> Xn+ Vn, 


OGr, 

dZr,. 


= E 


dVn+l dVn+1 


dx. 


n+1 


dy, 


'n+1 


{Pn^{zn<D„} ^n^{zn>D„} C„ (1 + £„)) 1j J/ra 


(60) 


where for each case above, the random variables Xn+i and y-n+i within the expectations are given by 
Eqs. (15) and (16), respectively. 


The results follow readily by setting the right sides of Eqs. (59) and (60) equal to zero and simple 
manipulations. Note that dGn{zn,Xn,yn)/dzn is monotonically decreasing in due to its concavity, 
shown in part (1) of Lemma Consequently, there are unique solutions to each of these equations. □ 


Proof Corollary For period iV, the independence of xjq or yjq is obvious since this is a single period. 
For period n < N, revisit Eqs. (59) and (60). Note that Xn+i is independent of {xn,yn) by Eq. (15) 
while 2/n+i is dependent of Xn + yn by Eq. (16). Therefore, a„ and j3. 

(60) are dependent on + yn only, and thus completes the proof. 


implicitly given by Eqs. (59) and 

□ 


Proof of Lemma 1^ To prove (a), we only give the proof for the case of increasing f{x) and g{x). The 
same argument can be applied for the case of decreasing f{x) and g(x). 

Let X' be another random variable which is i.i.d. of X. Since f{x) and g{x) are increasing, we always 
have [f{X) — f{X')][g{X) — g{X’)\ > 0. Taking expectations with respect to X and X' yields 

¥.[[f{X)-f{X')MX)-g{X')]] 

= E[f{X)g{X) + f{X')giX') - /(X')ff(X) - f{X)g{X')] 

= E[fiX)giX)] + E[f{X')giX')] - E[f{X')]E[g{X)] - E[fiX)]E[g{X')] 

= 2E[fiX)g{X)] - 2E[f{X)]E[g{X)] > 0. 

The result of part (a) readily follows from the above. 

In a similar vein, we can prove part (b) via changing the direction of the inequality above. □ 


Proof of Theorem]^ We only prove the result for a„. The same argument can be applied to prove 
the result for /3„. 

In view of Eq. (|59[) , is the unique solution of the equation below. 


E 


dVu+i 

dyn+i 


{Pn^{a„<Dn} ^n^{an>D„} 0„(l+fn)) 


= -E 


dVn+i 

^{06ri>Dn} 

dXn-\-l 


(61) 


Since > 0 by Lemma part (2), the equation above is negative, which implies 

{Pn^{a„<D„} ~ ^ral{aTi>£*n} ~ +)) 


E 


dVn+i 1^1 

dy, 


n+1 


< 0 . 


(62) 


Further note that for any realization of demand = d > 0, the two terms of the left hand side of Eq. 

(^: 

dVn+i{Xn+l{d),yn+l{d)) 

dyn+i{d) 

and p(il{a„<d} ~ ~ + (!+£„) are both increasing in d. Specifically, the first term is increasing 

by the concavity of Vn+i [cf. Lemma part (2)] and Eq. (16). Then, by Lemma and Eq. (62), one 
has, 


E 


dVn+l 

dyn+i_ 




^nl{a„>D„} — c'„(l + £„)] < 0 


(63) 
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Since > 0 by Lemma part (2), the above inequality implies 

^ \Pn'^{an<iDn} Dn} ^n(l “t ^n)] ^ O5 

which, after simple algebra, is equivalent to — c„ • (1 + £„) — (p„ — s„)i^„(an) < 0. The above further 
simplifies to 

Tpr \ ^ Pn Cn ■ (1 + ^n) 

F(an) > -. 

Pn 


By Eqs. (20) and (22), the right hand side in the above inequality is Fn{a^). Thus, we have F„(a„) > 
Fn(a„), which completes the proof for by the increasing property of F„(-). □ 


Proof of Proposition To prove part (i), it suffices to prove that Vn{xn,yn) < Vn{xn — d,yn + d) 
for arbitrarily small d > 0. To this end, consider the initial state {xn — d,yn + d). Then, the firm can 
always purchase d units without any additional cost to reset the initial state to be (Xn, yn)- This means 
^n(Xm yn) — ^n(Xn d, y^i “t" d) . 

The proof for part (ii) follows from part (i). Considering the derivative of Vn(xn — d,yn + d) with respect 
to d, we have 


Vn{x - d,y + d)-Vn{x,y) , ^ 

hm --- = -dVn[x,y) dx + dVn(x,y) dy > 0 

d-fO a 

where the inequality follows from part (i). Finally, part (ii) readily follows by rearranging the above 
equation. □ 


Proof of Proposition]^ To prove Part (i), we note that: 

i^Xfij yn) — max IE (^Xn-\-l , yn+l )] ^ IE [bn+1 (0: ^n+1 ^n+l)] — i^Xn , yn) 

Zn ^Xn 

where the inequality above follows from Proposition [^i) for period n + 1 with d = Xn+i- 
For part (ii), we only show that since the same argument can be applied to prove > Pn- 

To begin with, note that by Lemmaj^one can show that E[V)i_|_i(0,^„+i(z„))] is concave in and its 
derivative is decreasing in Zn- Therefore, Zn = is the unique solution of E[14+i(0, Cn+l(^n))] - 0. 
In addition, the derivative of E[y„+i(0,^„+i(z„))] is positive for and negative for z„ > a^- 

Therefore, it suffices to show that at z„ = a„ the following is true 


dz, 


-E 


ldi+l{0; Xn-irl{,^n) T yn-irli^n)') 


> 0 . 


(64) 


It is easy to show by backward induction that, dI4,+i(0, a;„+i(z„) +?/n+i(-Zrt)) /dzn is bounded for every 
Zn in terms of a function of ZI„, (the last period i?jv(ZIjv, ^at, xjv) + Ki\f{q]\[,ypj) is bounded for any 


D]\r). The previous condition allows the interchange between differentiation and integration; cf. Widder 
(|1989). Accordingly, we have the following. 


(®[Pn+l(0, ^ra+l)] 

dZn 


= E[ 


= E 


> E 


(O5 Cn+l) j 

dZn 
9Idi+l 


d^n+1 
dVn+1 
dx- 


n+1 


l{z„>D„} + 

l{z„>D„} + 


dVr 


dy., 


“ c'„(l + ^n)) 

{Pn^{zn,<Dri} ~ ~ + ^n)) 


d^n+1 

i9t4,+i 


n+1 


= 0 , 


where for simplicity we write := dv„+,{x^+uy^+i) dVn+i{x„^uy^+i) ^ 

^ ofn+i ’ ax„+i ax„+i oy^+i oy„+i 

The inequality above is justified using backward induction as follows. 
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First, since the marginal contribution of profit of an additional unit of capital for Vlj+i(0, is larger 

than that of 14 +i(a;„+i, j/„+i) where = x„+i + we have: 


l/n+l)/^2/n+l ^ ^n+l)/^^n+l, 

^h^+l(^n+l5 Un+l)/^^n+1 ^ ^n+l)/^^n+l- 


Second, since Zn = On is the unique optimum of E[Vlj+i(x„+i, y„+i)], its derivative at = q;„ is zero. 
This proves Eq. (641 and thus completes the proof. □ 


Proof of Proposition For period TV, the result readily follows from the optimal solution of the 
single-period model. For all other periods, we only prove the result for d„ > q;„ since a similar argument 
can be used to prove > /3„ by replacing £„ with z„. 

By Proposition we have a„ < and is by differentiating Eq. (29) and setting the derivative to 
zero, that is. 


E 


^^^+1 1^1 U ' 1 ^ \ 0 W 

-oc- >£>„} + Pn^{a^<D„} — 'T'n^{a^>D^} “ C„li -f 

o<;n+i 


= 0 . 


(65) 


For any realization of demand Dn = d > 0 the term 9i4i-i-i(0i +iid))/d^ n+i{d) is decreasing in d by 
the concavity of Vn+i [cf. Lemmaj^part (2)] and the fact that ^n-i-i is increasing in d by Eqs. @-®. 
Furthermore, the term l{a„>d} + p'^l^a^d} - K'^{a„>d} - c(i(l + f„) = Pn - {Pn + K “ l)l{a„>d} - 
c'^(l + £n), is increasing in d. By Eq. (|65[) and Lemmaone has 


E 


W„+i(0,C„+i) 


dC. 


n+1 


' ® + Pn^{a^<D„} ~ ^nl{a^>D„} ~ c(j(l + £„)] > 0. 


Since dVn+iiO,^n+i)/d^n+i > 0 by Lemma i part (2), the above inequality implies 

® [l{ai>£l„} + Pn^{a^<D„} ~ >£>„} ~ + £n)\ > 0, 


( 66 ) 


which, after simple algebra, is equivalent to — c„ • (1 -f f^) — (pn + hn — c„+i)F„(a^) > 0. The above 
further simplifies to 




Pn On * (1 “t“ fn) 


Pn T ^n+1 

Note that the right hand side of the above is less than 1 since c„(l -I- £n) + hn > c„+i by assumption. 
Next, by Eqs. and (27), the right hand side in the above inequality is Fn{an)- Thus, we have 
Fn{(in) > Fn{oin), which means din> otn- Thus, the proof for q;„ > is complete, since > a„ by 
Proposition □ 


Proof of Theorem]^ Since VniO is increasing and concave in to prove part (i), we can follow the 
proof for Theorem]^ by simplifying the two-variable state (x„,j/„) as The two threshold values 
and (3n can be obtained via solving the first order conditions under loan with rate and deposit with 
rate r„, respectively. 

To prove part (ii), we only need to prove the first inequality since the second one has been proved 
by Proposition!^ This can be done via backward induction. First, for the induction basis, note that 
for the last period TV, one has Vn{x + y) = Vn{x,y). Next, for the induction step, assume that 
the inequality holds for periods n -I- 1, n -|- 2,..., TV. Then, for any ^n-i-i = Xn+i + Pn+i, one has 
E^i(Cn-i-i) > ^n+ii^n+iTyn+i)- Noting that is a function of and Dn- Taking expectations 

w.r.t. Dn yields ^(^ „+i)] > E[f^]^(x„+i,?/„+i)]. Finally, taking the maximum over Zn, we obtain 

that the inequality (Cn) > ^ni^n^yn) holds, and the proof is complete. □ 


Proof of Theorem The proof readily follows via a straightforward modification of the proof of 
Theorem □ □ 
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Proof of Theorem!^ The proof follows the same steps as in Theorem and Theorem [^counterparts, 
with some minor modifications. □ 


Proof of Theorem The proof follows readily from the proof for Theorem [^ by replacing the 
inventory-cash flow equations to be those of Eqs. (37)-(38). □ 
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